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Abstract. In this paper, we study the boundedness of pseudo-differential 
operators with symbols in S™ s on the modulation spaces M p ' q . We discuss 
the order m for the boundedness Op(S™ s ) C C(M p ' q (K. n )) to be true. We also 
prove the existence of a Calderon-Zygmund operator which is not bounded on 
the modulation space M p ' q with q 7^ 2. This unboundedness is still true even 
if we assume a generalized T(l) condition. These results are induced by the 
unboundedness of pseudo-differential operators on M p ' q whose symbols are of 
the class ,5 with < 6 < 1 . 



1. Introduction 

The modulation spaces M p - q introduced by Feichtinger 5, 6 are fundamental 
function spaces of time-frequency analysis which is originated in signal analysis 
or quantum mechanics. See also [7] or Triebel [55]. Recently these spaces have 
been also recognized as a useful tool for the theory of pseudo-differential operators 
(see Grochenig [10]). The objective of this paper is to discuss the boundedness 
of pseudo-differential operators and also the unboundedness of Calderon-Zygmund 
operators on modulation spaces. 

The boundedness of pseudo-differential operators on the modulation spaces was 
studied by many authors, for example, Grochenig and Heil [TT], Tachizawa |19j . 
and Toft [20]. They proved that pseudo-differential operators with symbols in 
some modulation space are M p,9 -bounded, and as a corollary we have the M p,q - 
boundedness of pseudo-differential operators with symbols in Hormander's class 
Sq . A pioneering work of Sjostrand [15j should be also mentioned here which 
proved the L 2 -boundedness by introducing a symbol class based on the spirit of 
time-frequency analysis. We note here that L 2 = M 2,2 . 

In this paper, we consider the case of general symbol classes S™ g . First we recall 
the result of Calderon and Vaillancourt PQ, which shows that pseudo-differential 
operators with symbols in Sg s with < 5 < 1 (hence in S° s with < S < p < 1, 
5 < 1) are L 2 -bounded by reducing them to the case of . The proof was carried 
out by "dilation argument" based on the fact 

||/(Ax)|| L2(K) = A-"/ 2 ||/( a ;)|| i2(R) , A>0. 



2000 Mathematics Subject Classification. 42B20, 42B35, 47G30. 

Key words and phrases. Calderon-Zygmund operators, modulation spaces, pseudo-differential 
operators. 

1 



2 



MITSURU SUGIMOTO AND NAOHITO TOMITA 



We can conclude that the operator norm of a(X, D) is equal to that of a(XX, \~ 1 D) 
from this equality. By following the same argument, we can also expect that pseudo- 
differential operators with symbols in S® s with < S < 1 are M p,9 -bounded. 
However, the dilation property of the modulation spaces M p ' q is rather different as 
was investigated in author's previous paper p~7], and due to the property, we can 
give the following negative answer to this expectation: 

Theorem 1.1. Let 1 < q < oo, m£l, < <5 < p < 1 and S < 1. Then we have 
the boundedness Op(S™ s ) C £(M 2 ^(R")) if and only if m < -\l/q - l/2\dn. 

The "only if" part of Theorem 11.11 is a restricted version of Theorem 13.61 which 
says that Op(5™ 5 ) C £(A/ M (R™)) only if to < -\l/q - l/2\Sn. This result was 
first proved in author's paper [18]. The "if part is a restricted version of Theorem 
13.11 in Section [3] which treats the general M p ' 9 -boundedness with to < m(p,q), 
where m(p, q) is an index such that m(2, q) = — \l/q— l/2\Sn. We remark that the 
boundedness Op(S™ 5 ) C £(M?'«(R n )) with to < -\l/q - l/2\dn (Proposition 
is a straightforward consequence of the dilation argument stated in the above if we 
directly use the dilation property (Proposition 12. 1| of the modulation spaces. The 
main contribution of Theorem 1 1.1 1 is the boundedness result with the critical order 
for m. 

Theorem 11.11 also indicates a difference between LP spaces and the modulation 
spaces MP't. Fefferman [4 proved that Op(5^) C £(L P (M™)) if to < — — 
1/2 1 ( 1 — p)n, < S < p < 1 and 8 < 1. Moreover, it is known that this order of m is 
critical ([THl Chapter 7, 5.12]). We remark that, for the L p -boundedness of pseudo- 
differential operators with symbols in S™g, the critical order of to is determined 
by p. On the other hand, Theorem 1 1 . 1 1 savs that, for the M p ' 9 -boundedness, the 
critical order of to is determined by d (at least, in the case p = 2). 

By developing the investigation of pseudo-differential operators, we can also dis- 
cuss the boundedness property of Calderon-Zygmund operators on the modulation 
spaces. A Calderon-Zygmund operator is an L 2 -bounded linear mapping whose 
distributional kernel is a function K(x,y) outside the diagonal {x = y} satisfying 

\K(x,y)\ <C\x-y\- n , 

\K{x,y)-K{x',y)\<c } X ~ X '^ for \x - y\ > 2\x - x% 
\x — y\ n+£ 

\K(x, y) - K(x, y')\ < C ly ~ ^ for \x - y\ > 2\y - y'\, 
\ x V\ 

where < e < 1. It is well know that Calderon-Zygmund operators are L p -boundcd 
for 1 < p < oo (see, for example, [3j Theorem 5.10]). In this paper, we consider 
the problem "Are Calderon-Zygmund operators M p ' 9 -bounded?" . It is easy to 
show that the L p -boundedness of the operators of convolution type induces the 
M p ' 9 -boundedness. Hence, Calderon-Zygmund operators of convolution type (Riesz 
transforms, for example) are always M p ' 9 -bounded. We will prove that it is not 
generally true if remove the convolution type assumption. The following theorem 
is a simplified version of Theorem 14.11 in Section 0J 

Theorem 1.2. Let 1 < p,q < oo. If q ^ 2, then there exists a Calderon-Zygmund 
operator which is not bounded on M p ' q (W l ). 
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Theorem 1 1.2 1 is a direct consequence of the unboundedness of pseudo-differential 
operators on the modulation space M p ' q whose symbols are of the class S® s with 

< S < 1 (see Theorem I3.6[) . In fact, it is know that such pseudo-differential 
operators are Calderon-Zygmund operators (see [16l Chapter 7, Sections 1 and 2]). 

On the other hand, we know some boundedness results on the Besov spaces B^ q 
and Triebel-Lizorkin spaces F^ q . By the same reason described above, Calderon- 
Zygmund operators of convolution type are always _Bp ,9 -bounded. Furthermore, in 
the case of non-convolution type, the following generalized T(V) condition is useful 
to discuss the £?p' 9 -boundedness of T: 

(1.1) T(P) = for all polynomials P such that deg P < I. 

This condition, together with an extra condition on the smoothness of the kernel 
of T and the weak boundedness property which will be defined in Section 01 induce 
the -Bp ,9 -boundedness of T, where s is determined by the order of the polynomials 

1 and the smoothness order of the kernel (see Lemarie [T3] , Meyer and Coifman []3J 
p. 114]). For the -Fp^-boundedness, we need more conditions on the transpose T* 
of T, that is, a smoothness condition of the kernel of T* and the condition 

(1.2) T*(P) = for all polynomials P such that deg P < t 

(see Frazier, Torres and Weiss [8]). We remark that the boundedness on the homo- 
geneous spaces (Bp' q ,Fp' q ) induces that on the inhomogeneous spaces (Bp' q ,Fp' q ) 
under suitable conditions. 

On account of these results, we can expect the M p,9 -boundedness of Calderon- 
Zygmund operators T which satisfy the smoothness conditions on the kernels, con- 
ditions (|l.l[) - (|1.2p . and the weak boundedness property. But even if we assume 
these reasonable conditions, we can never prove the M p,9 -boundedness of Calderon- 
Zygmund operators. See Theorem 14. II for the detailed statement. 



2. Preliminaries 

Let 5(R n ) and 5'(R ra ) be the Schwartz spaces of all rapidly decreasing smooth 
functions and tempered distributions, respectively. We define the Fourier transform 
Tj and the inverse Fourier transform T^ 1 f of / € S(R ra ) by 

*7(0 = /(£)=/ e-^f(x)dx and ^f{ x ) = ^—t e** 

We introduce the modulation spaces based on Grochenig [3] . Fix a function 7 6 
<S(R n ) \ {0} (called the window function). Then the short-time Fourier transform 
V-yf of / € <S'(R™) with respect to 7 is defined by 

V 7 f(x, = (/, M € T x7 ) for x, £ G K n , 

where M^{t) = e l ^'*7(i), T x j(t) = j(t — x) and (•, •) denotes the inner product on 
L 2 (M"). We note that, for / G S'(R n ), V 7 f is continuous on M 2n and |V 7 /(a;,£)| < 
C(l + |x| + \£\) N for some constants C, N > (0 Theorem 11.2.3]). Let 1 < p, q < 
00. Then the modulation space M p ' 9 (R n ) consists of all / G S'{R n ) such that 




!\\m„ = W-JU,; = < / \Vyf(x,t)\* dx rfC < 00 



q/p 



i/<i 
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We note that M 2 ' 2 (R n ) = L 2 (R n ) (0 Proposition 11.3.1]) and M p ' q (R n ) is a Ba- 
nach space ([9j Proposition 11.3.5]). The definition of M p ' q (M. n ) is independent of 
the choice of the window function 7 S <S(R n ) \ {0}, that is, different window func- 
tions yield equivalent norms ([9l Proposition 11.3.2]). We denote by C(M p ' g (W 1 )) 
the space of all bounded linear operators on M p,q (M. n ). 

In order to state the dilation property of the modulation spaces, we introduce the 
indices. For 1 < p < 00, p' is the conjugate exponent of p (that is, l/p + l/p' = 1). 
We define subsets of (l/p, I/9) <E [0, 1] x [0, 1] in the following way: 



h : min(l/g, 1/2) > l/p, 
h ■ min(l/p, l/p') > l/q, 
h : min(l/g, 1/2) > l/p', 
See the following figure: 

1/9 



n 



max(l/g, 1/2) < l/p, 
max(l/p, l/p') < l/q, 
max(l/g, 1/2) < l/p'. 



1/2 -- 



h 


h 


/ I 


2 \. 
1 



1/2 

Ml(P, ?) 

We introduce the indices 



l/p 




max{0, l/q — min(l/p, l/p')} — l/p, 
M2(P, q) = min{0, 1/g - max(l/p, l/p')} - l/p. 



Then 



2/p+l/g if (l/p,l/q)eh, 

i'>(i>-<n = {-i/p if (i/p,i/?)€/ 2) 
1/9-1 if (l/p, 1/9) e h, 

-2/P+1/9 if (l/p, 1/9) e Jf, 
/'.(/'■'/' = if {i/p,i/q)er 2 , 

1/9-1 if (l/p, 1/9) e It 

We define the dilation operator A a by A a f(x) = f(ax), where a > 0. The following 
proposition plays an important role in the proofs of Theorem 13.11 and Proposition 
3~2l 

Proposition 2.1 ( [17} Theorem 1.1]). Let 1 < p,q < 00. Then the following are 
true: 

(1) There exists a constant C > such that 

||A a /|| M ».<» < Ca"" 1 (m) ||/||mp.* for all f € M p '"(E. n ) and a > 1. 
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(2) There exists a constant C > such that 
||A q /||a/p, 5 < Ca n ^ p ^\\f\\ M p^ for all f G M p > q (R n ) and < a < 1. 
The optimality of the power of a in Proposition ^. H is also discussed in [T7] . 

3. The boundedness of pseudo-differential operators 

Let m G M and Q < 5 < p < 1. The symbol class consists of all a G 
C°°(M" x R n ) such that 

^(TfoOl < Ca,/j(l + |e|) m -"l Q ' +A 'l' 3 l 

for all a, /3 G Z™ = {0, 1, . . . }". We denote by | • |s- 5 ,jv, 2V = 0, 1, . . . , the semi- 
norms on S™ s , that is, 

W\s 7s .n= max sup (1 + \^ m -"^ +5 ^\d^a(x,0l 
For a £ S^g, the pseudo-differential operator <r(X, D) is defined by 
a(X, D)f(x) = — L- / e ix < a(x, /(£) d£ 



(2tt)* 

for / € (S(]R n ). We denote by Op(5 , ™ (5 ) the class of all pseudo-differential operators 
with symbols in S™ s . Given a symbol a £ S™ s with 6 < 1, the symbol a* defined 
by 

(3.1) tT *( x ,S) = O fh7 -L- [ [ e^y<a(x + y^ + C) dy d( 

\ Z7T ) JR™ JR™ 
1 



= lim—_/ / e-^ X (cV,<)^ + »,e + C)dydC 
satisfies ct* G S™ s and 

(3.2) (ir(X t D)f,g) = (f,a*(X,D)g) for all /,«? G S(R n ), 

where x G 5(E 2 ™) satisfies x(0,0) = 1 ([H Chapter 2, Theorem 2.6]). Note 
that oscillatory integrals are independent of the choice of \ G 6>(R 2n ) satisfying 
x(0, 0) = 1 ( |12[ Chapter 1, Theorem 6.4]), and the derivatives of <7*(x, £) can be 
written as 

(3.3) d?d£v*(x,Z) = B - 7 ±- [ f e-^< (d^a)(x + y,C + OdydC 

in virtue of [H Chapter 1, Theorem 6.6] (see also [H p.70, (2.23)]). 

Our main result on the boundedness of pseudo-differential operators is the fol- 
lowing: 

Theorem 3.1. Let 1 < p, q < oo, m £ K, < S < p < 1 and 5 < 1. 7/ 

m < ~ /*a(p, tten Op(S™ 5 ) c £(M™(R™)). 

In order to clarify g) — /i2(p, ?), we divide 7i, . . . , J| in the following way: 
Jx : (Jj n J 2 *) U (J 2 n 7J), J 2 : (Jj fl J 3 *) U (J 3 n J 3 : (/ 2 H / 3 *) U (J 3 fl / 2 *). 

See the following figure: 
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1/2 1 1/p 

Then we have 

(\l/p-l/q\ if (i/p,i/ff)e Ji, 

A»i(p,?)-A»a(P,?) = <|2/p-l| if (1/p, 1/g) € J 2 , 

[|l/p + l/g-l| if (l/p,l/g) G J 3 . 

Let -00,-0 G S(M n ) be such that supp-0 o C {£ : |£| < 2}, supp-0 C {£ : 1/2 < |£| < 
2} and O (C) + E^Li V>( 2_i £) = 1 for a11 £ G Set 0j = 0>(2^'-) if j > 1. Then 

OO 

(3.4) H^VylU- < C a 2- J 'l a l, suppl e {2J- 1 < |e| < 2 J ' +1 }, £)^ = L 

3=0 

The following weak form of Theorem 13. II (when 8 < 1) is a straightforward conse- 
quence of the dilation property of the modulation spaces ( Proposition 12. ip . 

Proposition 3.2. Let 1 < p,q < oo, m G R and < S < p < 1. If m < 

(P,?) - f*a(p,g))*n, tten Op(S p m 5 ) c £(M*'(R B )). 

Proof. Our proof is based on that of [THl Chapter 7, Theorem 2]. Let cr G S™^ By 
the decomposition (|3.4[) . we have 



3=0 j=0 

Since aj(X,D) = A 2J s o- j (2-^ s X, 2^ 5 D) A 2 -n, by Proposition O we see that 



\a(X,D)f\\ MP . q <J2\\a 3 (X,D)f\ 



Mv.i 



3=0 



J2\\A 2JS o- j (2-^X,2^D)A 2 - jS f\\ 

3=0 



A[v,q 



<^2^^^«)-^fe«))|| ( r i (2-^X,2^£»)|| £(M p, 5) ||/||M P ., 

3=0 

for all / G <S(R"). Since 5™,, C S% s and 1 + 2 j5 \^ ~ 2 J ' on supp V'j (2 Jl5 -), if we set 
Tj(a;, = 2-J' m cr J (2-^3j, 2^£), then for any a,0 G Z£ 

l^r i ( a r > OI<C , a J /9H sr , J | a+/3 | 
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for all j e Z+. Hence, by Op(5g -0 ) C C(M p ' q (R n )) and m+([j,i(p, q)-^{p, q))Sn < 
0, we have 

oc 

^ 2 3tff»(Mi(p,9)-**»(P,«))|| - i (2-i* J x:, 2^C)|| £(MP . 9) ||/|U /P ,, 



= ^2^ m +^^)-P2(p, 9 ))fc)|| Tj(X;jD) || £(Mp9) || / || Mp? 
3=0 

< C ^2^ m+ ^ M )-^'«» 5n ^ ll/IU/™ =C||/|| A f,., 

for all / € 5(K n ). The proof is complete. □ 

In view of Proposition ^. 21 the non-trivial part of Theorem l3.1l is the boundedness 
with the critical order m = —(pi(p,q) — (j,2(p,q))5n. The rest of this section is 
devoted to the proof of it. Let tp £ 5(R") be such that 

(3.5) supple [-1,1]" and ^ tp(£ - k) = 1. 

By the decompositions (|3.4[) and (|3.5[) . we have 

l = f>(0=f>W E v(2-^-fe)J [2 V(2-^-^) ■ 

j=o j=o VfeeZ" / \£ez" / 

Hence, 

oo 

( 3 - 6 ) E E E - fc ) ^ 2-i ^ - £ ) ^ (0 = 1 

for all (y, £) e R" x M™. For v € S™ s , we set 

(3.7) (x,C) =^(2-^D x -A;) < 7(a; > 0v(2- J '^-^Vi(0 > 

where 

¥>(2-^ a i? a - fc)a(z,0 = ^ l [ V {2^ 5 ■ -k) ^a(-,0](x) 

= 7o~vr / ^ y(2 _i 'i/ - k ) FMv, dy, 

(2tt)« J Rn 

T\ and ^j -1 are the partial Fourier transform and inverse Fourier transform in the 
first variable, respectively. 

Lemma 3.3. Let 1 < p < oo, m G E, < 8 < p < 1 and cr S S^. Then there 
exists a constant C > suc/i £/ia£ 

\\a k /{X,D)f\\ LP <CV m {\ + \k\)- n - 1 \\f\\ LP 
for all j £ Z +7 k,£ £ Z™ and / £ S(R n ), where ay is defined by (|3 . 7|) . 
Proof. Using <t*^(X, D) = A 2JS cr^-^X, 2^D) A 2 - 3 - 5 , we have 

Htr^fX.i?)/!!^ = 2-M*\\<r k A2-t s X,2? s D)k i - il f\\„ 
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for all / G S(R n ). Set 



Since 



a W {2 -i s X,V s D)A 2 - 3S f(x)= I K k ' e (x,y)(A 2 - jS f)(y)dy, 



if 

(3.8) \K^{x,y)\<Cy™(l + \k\)- n -\l + \x-y\y 

for all j G Z+ and k,£ £ Z™, then 

lla^CX,!))/!!^ < C2-* n /*2*»(l + Ifcl)-"- 1 !^! + | • I)-"" 1 ] * \A 2 - iS f\\\ 



LP 



< C 2-^"/P2 jm (l + |fc|)""" 1 ||A 2 - 3 - 5 /|| 



02^(1 + \k\)- n - 1 \\f\\ 



LP 



for all j e Z+, M G Z" and / e 5(M"). This is the desired result. We prove 
Set Tj(x,£) = 2- jm <r(2-3 s x,2i s £)il> j (2i s £). Since 

4 e (x,0 = ^J k <* S *-*H{2^x-z)a{2-^z^)^{Od^ tp(2-i s Z-£), 



we have 



where $ = J-^ 1 Lp. On the other hand, for any a, f3 E Z™ , 

l^r i (x > 0l<Ca J /9H S ™„|a + /J| 

for all j 6 Z + . Let a, /3 € Z™ be such that |a|, |/3| < rt + 1. Using 
= C a ^ m j (()■/<■ ' v ; ) | / (dfe ifc >-*)) - z)Tj(z,£)dzj y>(£ - £)dg 



- Qj/3 Z ^ /3i,/32 

OL\-\-OI.2—OL 

e K*-vH | y e ik < x - z) d^^(x - z) d^d^T^z, f) dzj <9 Q V(£ - £) df, 
we see that 

\{x-y) a ^K k /{x,y)\ < ( C a3 \o\s~ ,| a+/3 | sup I^IU* sup ||^*|| L i j 2' m . 

\ "< Q /3</3 / 

This implies (|3.8p . The proof is complete. □ 

For < S < 1, we take a sufficiently large integer jo such that 
(3.9) y^ 1 -^- 3 > sfh. 

We recall that tp, ip G S(R n ) satisfy p C [-1, 1]" and C {£ : 2" 1 < |£| < 2} (see 
dUD and (33J). 
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Lemma 3.4. Let < 5 < 1 and £ € Z". // there exists a positive integer j(£) > 
jo + 1 such that supp ^(2~-?W< 5 • -I) n supp V>(2^ w -) 7^ 0, f/ien 

sup P¥ >(2-^ • -£) n supp = /or oH |j - > Jo, 
where jo is defined by (13. 9[) . 

Proof. Since supp ^(2"^ ■ -^) C {|f - 2^| < "2P S y/n\ and supp ^(2^-) C {2J" 1 < 
|£| < 2 J+1 }, °ur assumption supp ip(2~^ s ■ -£) n supp V>(2^ (£) •) ^ gives 

(3.10) S^W- 1 - y'W'VH < 2 J(£)5 K| < 2^ +1 + 2^'W 5 VH. 

Let |j - j(£)| > j - We consider the case j - j(£) < -j . By ([31?]) . (|3A0]) and 
jW > jo + 1, we see that 

2^\£\ - 2 jS \fn~ = 2 iS -^ 5+j ^ 5 \l\ - 2 j5 y/n~ 

> yHW^jW-i _ yWtyff) - y s Vn~ = 2 j5+j ^ 1 - 5 ^- 1 - 2^ 5+1 ^ 

> 2 i*+iW(i-*)-i _ 2 j<5+jo(i-5)-2 > 2 j«+3W(i-«)-i _ 2i*+JW(i-*)-2 

= 2 J<5+JW(i-<5)-2 = 2 i5+iW(i-5)-2-(j+i)+(i+i) = 2 {{jW-i)(i-*)-3}+j+i 

> 2 (io(l-<5)-3)+j+l > 2 J+1^> 2 i+l. 

Hence, 

supp ^(2- J4 • -I) C {|C| > 2^|£| - 2*Vn} C > 2 J+1 } 

for all j - j(f) < -jo- This implies supp <p(2 -3 ' a • -I) n suppi/>(2^'-) = for all 

j- jW < -Jo- 

In the same way, we can prove 

supp<^(2^ • -£) C < V s \£\ + 2* 6 s/E} C < 2^" 1 } 

for all j - j(£) > j . This implies supp ^(2-^ • -f) n supp^(2~ j -) = for all 

j -](£)> jo- □ 

Let 77 G <S(R") be such that supp 77 is compact and | 5Z„ eZ „ w(£ — > C > 
for all (el". It is well known that 

(3.11) (E hP-^/lll^ , 

where ??(£> — z/)/ = J r_1 [?7(- — v)f] (see, for example, [22]). 

Proposition 3.5. Le£ 1 < p < 00, to <E R, < <5 < p < 1, 5 < 1 and a e S™ s . If 
to < — (fii(p, 00) — /U2(P) oo))5n, i/ien i/iere exists a constant C > swc/i </iai 

||o-(X,.D)/|| MP ,~ <C||/|| M p,» 

/or / e 5(R"). 

Proof. In view of (|3.11j) . we estimate sup„ eZ „ \\<p(D — v){cr{X, £))/)||lp, where y> is 
as p.5p and / € <S(]R n ). By the decomposition (|3.6[) , we have 

OO 

jo 00 
fceZ" «gZ" 3=0 fcez™ fez™ j=j +i 
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where (x, £) is defined by ()3.7() . and jo is defined by (|3.9|) . We only consider 
the second sum since the estimate for the first sum can be carried out in a similar 



way. By Lemma [331 we see that 



E E E o= E E E 

feez»^ez«i=j +i fcez™£ez'» j>jo+i 

lj-3'WI<J0 

Since p(2~ J '* • —k) C 2 J ' 5 fe + [-2 js , 2^] n and 
^[<rf (X,Z>)/](y) 

= 7o~\n I ^ v [e ix M^ jS D x - fc) a(x, £)] <p{2~^ - t) V>(2"^) /(0 d£ 

= ?Ar / ^( 2 ^ 5 (y - - *) FMv - o ^(2^e - o ^(2- j o 7(0 de, 

we see that F[crf e (X, D)f] c 2^0 + i) + [-2 3 '* +1 , 2 J ' 5+1 ]". This gives 



tfp-v) \ E E E 

\ feez™ £eZ" i>j +i 
\ W-i(<)l<Jo 

= E E E v(D-v)4 e (X,D)f. 

fceZ" tez n ,i=i,...,« i>io+i 

2J" 5 (k i +l i )-v i \<23 s + 2 H—JW\<io 



Let 77 6 <S(R") be such that supp 77 is compact, 77 = 1 on supp ip and | X^ez™ ^(^ — 
v)\ > C > for all 
Lemma 13.31 we have 



v)\ > C > for all £ e E™. Note that cr^O,£) = ^(i, r/(2^^ - t). By 



\/ceZ"^GZ"io + l / LP 

^E E E MD-y)a¥[X,D)f\\ LV 

k£Z n ££Z n .i=l,...,n 3>3Q+1 

\23 s (k i +£ i )-iy i \<2J s + 2 \3~ H^)\<30 

^ C E E E Ikf (X, J D)[r ? (2-^ J D-^)/]|| i , 

feSZ™ f£Z n ,i=l,...,n J>io+l 
\2i s (k i +e i )-v i \<2i s + 2 W-i(*)Kio 

^ C E E E 2^(l + |fc|)-"- 1 ||r ? (2-^-^)/|U», 

fceZ" £GZ",i=l,...,n j>io+l 

Since rj(2~ jS D-£)f = A 2j s rj(D-i) A 2 -jsf, fJ,i(p, 00) = -l/p and m+ 00) - 

fi2(p,oo))Sn < 0, by (|3 . 1 1 [1 and Proposition ^. 11 we see that 

E E E 2^(l + |fc|)-"- 1 ||r ? (2-^D-€)/|| LP 

= E E E 2^-^)(l + |fc|)-«- 1 ||r ? p-^)(A 2 - iS /)|U, 

fcGZ" £6Z'\i=l,...,n j>jo + l 
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< 



< 



C E E 



J2 2 j{m - Sn / p \l + \k\)- n - l \\k 2 - jS f\\ 



Mp- 



f£Z",!=l,...,n 3>jo + l 
« i -(2-J" 5 y i -i- i )|<4 W-J(<)l<Jo 



^E E 



fcSZ™ £GZ'\i=l,...,n J>jo+l 

« i -(2-j" s u i -fc i )|<4 |j-jMI<jo 



&6Z™ 



|£ i -(2-J' 5 i' i -fc i )|<4 \ li— J(OI<J0 



<C(2j -lH £(1 + 1*1)"*- 1 



fcez» 



E 



< C(2j - 1)9" ( J] (1 



. €eZ",i=l,...,n 

\ |€ i ~(2-3' 5 „ i -fc i )|<4 / 




If' 



MP. 



-n-1 



||/||mp.°° = Cn,5||/||MP.°°- 



This implies 



feez" fez" io+i 



Mp- 



< C sup 



;Z" ^eZ™ j'o+1 



< C„, a ||/|| 



LP 



for all / G 5(K"). This is the desired result. 



□ 



In order to prove Theorem l3.ll we will use the following interpolation technique 
(see Toft [HI Remark 3.2]). Let M p ' q (R n ) be the completion of 5(R") under the 
norm || • ||jvfp.«- Then the following are true: 

(1) If 1 < p, q < oo, then M p ' q (W l ) = M p ' q (R n ), 

(2) If 1 < p u p 2 ,qi,q 2 < oo, < 9 < 1, 1/p = 6/ Pl + (1 - 6)/p 2 and l/q = 
9/qi + (1 - 6>)/g 2 , then (M Puqi (W 1 ), M P2 ' q2 (JH n ))e = M p ' q {R n ). 

We are now ready to prove Theorem 13. II 



Proof of Theorem \3Ji Let 1 < p, q < oo, < 5 < p < 1 and 6 < 1. We first 
consider the case (1/p, l/q) £ J\ with 1/p > 1/2. Then fJ,i(p,q) — (J>2(p,q) = 
1/p - l/q. We take 1 < r < 2 and < < 1 such that 1/p = 0/2 + (1 - 0)/r and 
l/q = 0/2 + (1 — 9)/oo. Since /Ui(r, oo) — fi 2 (r, oo) = 1/r, by Proposition 13.51 we 
have 



(3.12) 



Op(S p J" /r ) c £(M r '°°(R")). 



On the other hand, it is well known that Op(5° 5 ) C C(L 2 (R n )) ([323 Chapter 7, 
Theorem 2]). Hence, 

(3.13) Op(S° ) c £(X 2 ' 2 (K")). 
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By interpolation, (512)1 and (515)1 give Op(S° p •*+(- ft »/'0(i-«)) c 
Since (1 - 0)/r = 1/p- 1/g and A4 P ' 9 (R™) = M^'(l"), we obtain 

(3.14) Op(S~£ /p - 1/q)5n ) C £(M M (R n )) if (1/p, 1/q) G J x with 1/p > 1/2. 
In the same way, we can prove 

(3.15) Op(S~ ( f 1/p ~ 1/q+1)Sn ) C C(M p ' q (R n )) if (1/p, 1/q) G J 3 with 1/p < 1/2. 

Note that pi(p,<?) - p 2 (p,c/) = -1/p - 1/q + 1 if (1/p, 1/q) G J 3 with 1/p < 1/2. 

We next consider the case (1/p, 1/q) G Ji with 1/p < 1/2. Then pi(p, q) — 
fJ-2<J),q) = —1/p + l/g. Let cr G 5-(-i/p+i/9)*«_ Then CT *(x,L)) satisfies (I3~2l . 
where cr* G 5 ^ 1 /p+ 1 /<?)< 5 ™ j g defied D y (|3.ip . Let p', c/' be the conjugate exponents 
of p, c/, respectively. Since —{—l/p+l/q)8n = — {1/p 1 — l/q')Sn and (1/p', 1/?') G Ji 
with 1/p' > 1/2, by (|3l4|) . we see that ct*(X,L>) is bounded on M p '> q '(M. n ). Then, 
by duality and ([375]) . we obtain that a(X,D) is bounded on M M (R n ), that is, 

(3.16) Op{S// ( f 1/p+1/q)Sn ) c £(AP' 9 (R™)) if (1/p, 1/q) G Ji with 1/p < 1/2. 
In the same way, using duality and (|3.15p . we can prove 

(3.17) Op(S7j 1/p+1/9 ~ 1)5n ) c C(M p ' q (R n )) if (1/p, 1/q) G J 3 with 1/p > 1/2. 

Note that nx(p, q) - fi 2 (p, q) = 1/p +l/q-l if (1/p, 1/q) G J 3 with 1/p > 1/2. 

Finally, we consider the case (1/p, 1/q) E J%. Let 1/p < 1/2. Then pi(p, q) — 
A*a(p,g) = -2/p+ 1. Since (1/p, 1/p') G J x with 1/p < 1/2 and (1/p, 1/p) G J 3 
with 1/p < 1/2, (15161) and (15151) imply Op^Tjf 1/p+1/p ' )<5 ™) C C(M P ' P ' (R")) and 
Op(S , 7j~ 2/p+1),5,l ) c £(M^ (R n )). Then, by interpolation, we have 

V {S^f 1,p+1/p ' )5nB ~ { ~ Vp+1)5n[1 ~ e) ) C £(Af p '«(M")), 
where 1/q = 6/p' + (1 — 0)/p, that is, 

(3.18) Op(S7j~ 2/p+1)5 ") c C(M p ' q (R n )) if (1/p, 1/q) G J 2 with 1/p < 1/2. 

In the same way (or duality with (|3.18j) ). using interpolation, ()3.14j) and (|3.17|) . we 
can prove 

Op(S;¥ /p - 1)Sn ) C £(M™(R n )) if (1/p, 1/q) e J 2 with 1/p > 1/2. 

Note that fn (p, q) - fi 2 (p, q) = 2/p-l if (1/p, 1/q) G J 2 with 1/p > 1/2. The proof 
is complete. 

In order to prove the "only if" part of Theorem 11.11 we introduce a special 
symbol. Let <p,r] G 5(R n ) be real-valued functions satisfying 

<p: supp^C {MCI < 1/8}, / =1. 

77: supp?7 C : 2" 1 / 2 < |e| < 2 1 / 2 }, 77 = 1 on {£ : 2" 1 / 4 < |£| < 2 1 / 4 }. 

Moreover, we assume that tp is radial. This assumption implies that $ is also 
real-valued, where $ = T~ X Lp. Then we define 

(3.19) a(x, = £ Vm f Z e- 2fe - (23V2 *- fc) $(2^/ 2 a; - Jfe) j rj(2 _i 0, 

J=JO \o<|fc|<2i s /2 / 
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where < S < 1 and jo £ Z+ is chosen to satisfy 

(3.20) i + 2^ s -V +1 < 2 1 / 4 , 1 - 2 jo ^-^ +1 > 2- 1 / 4 , 2-3° 5 / 2 ^<2-' i . 

The symbol a* is constructed from a using the oscillatory integral (|3.1[) . The 
following is the "only if" part of Theorem 11.11 

Theorem 3.6 ([TBI Theorem 1.1]). Let 1 < p, q<oo, 0<5<1 and m > 
— \l/q— l/2\dn. Then the symbols a and a* defined by (|3 . 19|) belong to the class 
S™ s . Moreover, if q > 2 (q < 2 resp.), then the corresponding operator a(X,D) 
(a*(X,D) resp.) is not bounded on M™(M. n ). 

Precisely speaking, [Tg] treated only the case < 6 < 1, but the case 5 = can 
be also included by a simple argument. If m > and cr(£) = (1 + |C| 2 ) m ^ 2 , then 
cr(-D) is not bounded on L 2 (R n ). Indeed, 

MD)(M k f)\\ L 2 = (2n)- n / 2 \\a(D)(M k f)\\ L 2 

= (27r)-"/ 2 ||(l + |C| 2 ) m/2 /(• - fc)|U= > C\k\ m 

for all k £ Z", where / £ S(R") \ {0} such that supp / C {|£| < 1/2}. On the other 
hand, \\M k f\\ L 2 = \\f\\ L 2 for all k £ IP. Hence, a(D) is not bounded on L 2 (R n ). 
Moreover, a(D) is not bounded on M P,9 (R") for any 1 < p, q < oo. Indeed, since 
a(D)* = a(D), if a(D) is bounded on M p ' q (R n ), then ct(D) is also bounded on 
M p '< 9 '(MP). Then, by interpolation, a(D) is bounded on M 2 ' 2 (K n ). However, 
since M 2,2 (R") = i 2 (M"), this is a contradiction. Hence, a(D) is not bounded on 
JW?'?(r) for any 1< p, q < oo. Note that <r(£) = (1 + |£| 2 ) m/2 belongs to S 1 ^. 

4. The unboundedness of Calderon-Zygmund operators 

We recall the theory of Calderon-Zygmund operators based on [5] (see also |21)V 
Let T>(W l ) be the space of all infinitely differentiable functions with compact sup- 
port. For £ e Z + , we denote by V e (R n ) the space of all g £ X>(R") such that 
f m x g(x)dx = for all |/3| < I. Let T : V(R n ) -> X>'(R") be a continuous 
linear operator, where V(R n ) is the dual space of 2?(R"). We denote by K the 
distributional kernel of T, that is, 

(T/, g) = (K,g® f) for all /, g e X>(R n ). 

We say that T is a generalized Calderon-Zygmund operator of smoothness £ + e 
(we write T e CZO(£ + e)), where £ £ Z + and < e < 1, if the restriction of K to 
{(x,y) £ R n x K™ : x ^ y} is a function with continuous partial derivatives in the 
variable x up to order £ which satisfy 

\d2K(x,y)\<C\x-y\- n -M for \a\ < I, 

\x-x'\ e 



\d:K{x,y)-d«K{x',y)\<C, 



y^n+£+e 



for \a\ = e&nd \x-y\ > 2\x-x'\. Let £ V(R n ) be such that <p = 1 on {x : |x| < 1}. 
If T e CZO(^ + e) and / £ C°°{R n ) satisfies f(x) = 0{\x\ l ) as |x| -► oo, then the 
limit )im j - too {T(<f>(-/j)f),g) exists for all g € X> f (R™) (0 Lemma 1.19], [HI Lemma 
2.2.12]). In particular, T(a^) can be defined as an element of V' e (R n ), where \j3\ < £ 
and V' e (R n ) is the dual space of 2^(R"). Note that this limit limj^oc (T(<p(-/j)f),g) 
is independent of the choice of (j> (0 p.49]). It is known that, if T £ GZO{£ + e) 
is a translation invariant operator, then T(x 13 ) = as an element of T>' k (R n ) for 
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all |/3| = k < £ ([2TJ Proposition 2.2.17]). A continuous linear operator T is said 
to satisfy the weak boundedness property, if for each bounded subset B of V(W l ) 
there exists a constant C = C(B) > such that 



\{Tf x ' R , g x < R )\ < CR n for all f,g G B, xe R n and R > 0, 

where f x ' R (y) = f((y ~ x)/R). The transpose of T, T* : V(W n ) -> P'(R n ) is 
defined by 



Note that the kernel of T* is given by K*(x,y) = K(y,x). David and Journe 
[2] proved that, when T, T* G CZO(e), T is bounded on L 2 (R") if and only if 
T(1),T*(1) G BMOQSL n ) and T satisfies the weak boundedness property. 

Our main result on the unboundedness of Calderon-Zygmund operators is the 
following: 

Theorem 4.1. Let 1 < p, q < oo. If q 2, then there exists an operator T : 
S(R n ) -> S'(R n ) such that T, T* G CZO(£ + e) for all £ G Z+, w/iere < e < 1, 
T(P) = T*{P) = for all polynomials P , T satisfies the weak boundedness property, 
but T is not bounded on MP< q (R n ). 

By David- Journe's T(l) theorem mentioned above, as a corollary of Theorem 
14.11 we have Theorem 11.21 In the rest of this section, we prove Theorem 14. II 

Lemma 4.2. Let a be defined by (|3.19p with < 6 < 1 and jo satisfying (|3.20|) 
and 2^ {s -^+ 2 < T 1 ! 2 . Then a, a* £ 5™ 5 and (dfa)(x,0) = (dgo*)(x,0) = for 
all a G Z™ , where a* is defined by (|3.1|) . 

Proof. By Theorem 13.61 we have a, a* G S'"j. Since supper C {(z,£) : |£| > 
2 io-i/2} ) we obtain (dga)(x, 0) = for all a G Z£. 

Let Xi,X2 € 5(R n ) be such that xi(0) = x 2 (0) = 1 and suppxT, supp^2 C 
{|C| < 1}. Since suppTj^'-) C {2^ 1 / 2 < \(\ < V+ 1 / 2 } and suppx 2 (e-) C {|C| < 
1/e}, for each < e < 1, there exists N e such that supp?7(2 _J -) n suppx2(e-) = 
for all j > N e . Hence, by (|3.3|) . we see that 



(T*f,g) = (Tg,f) 



for f,geV(R n ). 





x e 



;I fc.(2^/ 2 (x+ a )-fe) $(2^/2^ + y) _ fc ) (fl o, f? )(2--»0 dC 



DC 



1 



lim V 2^ m -^ 



(27T) 



X2 (eC) (9 Q r ? )(2--'C) 



3=J0 0<|fc|<2J' 5 / 2 




PSEUDO-DIFFERENTIAL OPERATORS ON MODULATION SPACES 15 

oo . 

= ^E 2iM ° l) £ T^yT / X2(eC)(9^)(2^C)^f(x,C)rfC 

£ ^ j=3o 0< | fc| <2J<5/ 2 ^ ' R " 

By Plancherel's theorem, we have 

Vii( x >0= [ z~ lV< Xi(ey) e~* k < 23S/2 (*+y)- k ) <P(2J s / 2 (x + y ) _ k) dy 



1 XT((C + OA) 2-^"/ 2 e«-C e - lfc -( 2 - J,5/2 C') tpp-W 2 ? + k ) d£ ■ 



(27T)" 

Let j > jo, < < 2^/ 2 , < e < 1 and x £ R n . Since suppxi('A) C {|C'| < 1} 
and supp y(2-i & ' 2 -+k) C {|C'| < 2^ +1 }, we see that supp 77^(2;, •) C {|C| < 2^ +1 + 
1}. Therefore, our assumption 2 :, °( ,5 ~ 1 ) +2 < 2 -1 / 2 gives supp 17^(2;, •) C {|£| < 
23-1/2}. This implies supp (d a n)(2-^) n suppj^x, •) = 0, that is, (dgcr*)(x, 0) = 
0. The proof is complete. □ 

Lemma 4.3 ([TBI Chapter 7, Section 1, Proposition 1], [2TJ Lemma 5.1.6]). Let 

u £ Si 1 . Then, K, the distributional kernel of a(X, D) as an operator from S(M. n ) 
to S'(M. n ), is a C°° -function on {(x,y) £ E™ x M" : x ^ y} satisfying 

\d^K(x,y)\<c a ^x-y\- n -\ a \-^ 

for all a, ft £ U\. 

Lemma O says that, if a £ S$ A> then a(X, D),a(X, D)* £ CZO(£ + e) for all 
I £ Z+, where < e < 1 ([2TJ P-151, p.154]). 

Lemma 4.4 ( 21, p.152]). Let a £ Then 



o{X,D){aP) = (-i)^d^{e lx <a(x,0) 



for all (3 £ 7L\. 



Lemma 4.5. Let a and a* be defined by (|3.19p with m < 0, < <5 < 1 and jo 
satisfying (|3.20|1 and 2 J °(' 5 ~ 1 ) +2 < 2 -1 / 2 , and (13. . respectively. Then the following 
are true: 

(1) For aH £ € Z +7 cr(X, D), a(X, D)* £ CZO(^ + e), where < e < I, and for 
alll3£l n + , a(X,D)(x fj ) = a{X,D)*(x f3 ) = 0. 

(2) For alll£ Z+, o*{X,D), a*(X,D)* £ CZO(£ + e), where < e < 1, and 
for all [3 £ U\, a*(X, D)(x f} ) = a* (X , D)* {x fj ) = 0. 

Proof. Let m < 0. By Lemma S3 we have a, a* £ S^ s and (dfa)(x,0) = 
(dga*)(x, 0) = for all a £ Z™. Then, by C S? t ! and the remark below Lemma 
PI we get cr(X,L>),cr(X,D)* e CZO(£+e) for all £ £ Z + , where < e < 1. On the 
other hand, by LemmaOJ (<9|V)(a:,0) = for all aeZf gives a(X, D)(x f} ) = 
for all /JeZf. By 1(3"^]) . we have 

(o-(X,D)*f,g) = (a(X,D)g,f) = (a(X,D)gJ) 



= (g,a*(X,D)f) = (g,a*(X,D)f) = (a*(X,-D)f,g) 

for all f,g £ S(R n ). This implies a(X,D)* = a*(X, —D). Hence, by Lemma E3 
and {d a a*)(x, 0) = for all a £ Z™ , we see that 



V) = H^W^a* (*,-£)) 



= 
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for all (3 G ZIL. Therefore, we obtain Lemma 1431 (1). 

In the same way, we can prove Lemma l4~5l (2). Note that a*(X, D)* = W(X, —D). 

□ 

We are now ready to prove Theorem 14.11 

Proof of Theorem Let 1 < p, q < oo and q ^ 2. We only consider the case 
q > 2 since the case q < 2 can be carried out in a similar way. By Theorem 13. 6[ 
we see that a belongs to S™ S) but <r(X,D) is not bounded on M P ' 9 (R"), where a 
is defined by (|3.19p with m > (1/q — l/2)6n, < 5 < 1 and a sufficiently large 
integer jo. Since 1/q — 1/2 < 0, we may assume m < 0. Then, by Lemma 14.51 (1), 
we see that a(X, D),a(X, D)* G CZO(£ + e) for all £ G Z + , where < e < 1, and 
ct(X,L>)( 2 ; /3 ) = cr(X,L>)*(x' 3 ) = for all (3 G Z™. On the other hand, it is well 
known that, if d < 1, then pseudo-differential operators with symbols in S® s are 
bounded on L 2 (R n ) ([H Chapter 2, Theorem 4.1], 16, Chapter 7, Theorem 2]). It 
is easy to prove that the X 2 -boundedness of cr(X, D) gives the weak boundedness 
property of a(X,D). Hence, a(X, D),a(X, D)* G CZO(^ + e) for all £ G Z+, 
a{X 1 D){P) = a(X,D)*(P) = for all polynomials P, and a(X,D) satisfies the 
weak boundedness property, but a(X,D) is not bounded on M P,9 (R"). 
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